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ABSTRACT 

The Guttman model of scale analysis has found 
continued use in sociological analysi:.: despite criticisms placed 
against it. An empirical example is provided of the use of factor 
analysis with Guttman scaling even taking into account the criticisms 
of both very restricted item number of dichotomcus responses. Data 
came from a questionnaire using three theoretical lav scales. 
Attitudes, values, and aspirations regarding the legal institution 
vere solicited from high school students. Students indicated on the 
questionnaire if they strongly agreed, agreed, were undecided, 
disagreed, or strongly disagreed with each item. The responses vere 
coded such that the higher the score, the more favorable the attitude 
toward the legal institution. Factor analysis of all items using 
principal axis with varimax rotation was used. Scale analysis 
revealed that the scales were not Guttman. Although the scale and 
item reproducibilities were high, the scale scalabilities were not 
significantly greater than 0.60. Delineation of the structure of the 
scale is given as a justification for use of factor analysis with 
Guttman scales. It appears that the use of factor analysis with 
Guttman scales is not a desirable technique of scaling. A better 
approach would be the single use of factor analysis in order tc help 
construct single factor scales of greater length. (Author/RC) 
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The Use of Factor Analysis to Salvage Poor 
Guttiaan Scales: Can it Really Work? 

The Guttman model of scale analysis has found continued use in 
sociological analysis despite criticisms placed against it. Proctor 
(1970) questioned the acceptability of past methods of testing associated 
with it. Scaling by this technique has been called highly impractical 
and illogiccuL (Nunnally, 1968) as veil as being fadlsh and ritualistic 
(Labovitz, 1972). Perhaps in an atteaipt to handle such criticisms it- 
has been suggested that the factor analytic model be \ised in cooperation 
with Guttman scaling, particularly if vhe items do not meet the require- 
ments of reproducibility and scctlability. 

Schuessler (1966) noted that Guttman scaling and factor analysis 
are not necessarily incompatible models of scali ng, and advocated v^e of 
the scale model when the factor model failed. Gullahom and Oullahom 
(1968) advocated use- of both models when using survey data. Using data 
on attitudes toward interaction abroad and professional outcomes, they 
found one Guttman scale coxild be attributed to a common factor while 
another scale loaded on two factors. They noted that the two approaches 
are not incompatible: the scale model's value lies in its reproducibility 
criterion where the score indicates the pattern of item responses. The 
factor model permits reproduction of the congelations among items, rather 
than the pattern, but does allow information regarding the importance of 
any item in defining a factor. For their data the use of only one of the 
two methods would have resulted in the loss of structural information 
regarding the relations among the variables. 



While combining factor analysiR with Gutlansn scaling may in some 
cases provide a means of saving the scales, tbMe are limitations vith 
this approach. Guttman scales are rcorely long enough to provivle adequa*! 
tests of separate factors if they are found. Given a typical four or 
five Guttman scale, the reliability of the measurement of two or more 
factors would be restricted on the basis of the small number of items to 
measure each factor (parti collar ly if a composite method of scaling were 
used). In addition, if dichotomous responses were used in the factor 
analysis at least thirty items are typically needed to provide good 
results (Nunnally, 1968). Guttman scales which have low inter-item 
correlations, despite the presence of high item-total correlations, are 
unlikely to produce, therefore, any clearly delineated factor structure. 
Given the Guttman scaling requirements of reproducibilities and 
; scalabilities being high are not met, the scale items would based on the 
limitations noted al)ove, be of optimal use only if there were only one 
factor delineated. In this case rotation would be unnecesseuiy , and, 
therefore, the discovery of any clusters of highly interrelated sets 
of items would not be possible beyond those suggested by different 
signs on any bipolar factor, ^n short, the use of factor analysis to 
salvage Guttman scales is limited to those cases where the items are 
scalable as one factor only. The suggestion that factor analysis can 
delineate elaborate factor structure for Guttman sccJ.es is, therefore, 
exaggerated. / 



The purpose of this paper is to provide an empirical example of the 
use of factor analysis with Guttman scaling even taking into account the 
criticisms of both very restricted item number of dichotomous responses. 
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The stability of the results was investigated by use of a panel of 
subjects who responded to theoretical Guttxaan scale items for three waves. 

DATA AND THE VAR'lABLES 
The data for this paper come from au ongoing study of the industrial- 
~ tion of a rural ccMmnunity in northern Illinois. As part of this study, 
each year from 1966 to present (1973), high school students in both a 
control area and the area under industrialization were given a questionnaire 
asking infoxmation about their attitudes, values, and aspirations. For 
this study, reports of their attitudes toward the legal institution were 
used for all students with complete inlormation on the 1967 > 1968, and 
1969 waves (N=2l*U). Attitudes toward the legal institution were selected 
because of their important theoretical interest, because of +he avail- 
ability of comparison data using similar subjects in the past (Clark 
and Wenninger, 196U), and because the measurement of legal attitudes 
is often based on older, presumably Guttmaa scales (Rundquist and 
Sletto, 1936). 

The attitude toward the legal institution was measured by U items 
taken from Clark and Wenninger (196U). These items were: 

1. On the whole, policemen are honest. 

2. On the whole, judges are honest. 

3. A person should obey the laws no matter how much one has to go 
out of the way to do it. 

U, In the courts a poor man has the same chances as a rich man. 

5. Laws are made just for the good of a few. 

6. A person should tell the truth in court, no matter what. 

7* It is O.K. for a person to break the law if he doesn't get caught. 
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8. It is O.K. for a person to lie in court in order to protect a 
friend who is on tr^^J.. 

9. Almost anything can be fixed up in the courts if you have 
enough money. 

10. People who break the law are nearly always caught and punished. 

11. Just because a person gets himself in a comer is no reason 
to break the law. 

On the questionnaire the students were given the opportunity to indicate 
if they (l) strongly agreed, (2) agreed, (3) were undecided, (k) disagreed, 
or (5) strongly disagreed with each item. The responses were coded such 
that the higher the score, the greater the favorability of the attitude 
toward the legal institution. 

The theoretical law scales were the Rundquist-Sletto law scale 
(Rundquist and Sletto, 1936) which consisted of the first seven items, 
the Law scale taken from Clark and Wenninger {196k) which consisted of 
items 3, 5, 7, 10, and 11, and the Court scale also taken from Clark and 
Wenninger {l96k) which consisted of items 1, 2, k, 6, 8, and 9- These 
scales were developed and have been used as Guttman scales. 

To insure comparability of results based on the Guttman scaling 
analysis, coding similar to that used by Clark and Wenninger {l96k) 
was used. For all items but two (items 10 and 11) a positive response 
was coded if "strongly agree" was checked. For items 10 end 11 a positive 
response was coded if "agree" or "strongly agree" was Indicated. 
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RESULTS 

GUTTMAN SCALE ANALYSIS 

In Ta'^le 1 the item marginals and item errors cure given for the 
Rmidquist-Sletto scale for the three waves of observation^;. Over the 
three years the rank order of the items remained relatively stable 
With the exception of the first two items relating to the honesty of 
policemen and Judges, the level of positive responses rose each year. 
That is, the level of anti-legal attitudes increased over the three 
years of the study. The item errors were somewhat less stable. The 
coefficients of reproducibilities for the scale were .90, .90, and 
•92 over the three years. However, the coefficients of scalability 
were not greatly over .60, which indicates that the quality of the scale 
was somewhat low. Over the three years the percent of pure scale 
types were kk percent for 1967, 5^ percent for 1968, and 57 percent for 
1969. Over all three years there were more errors over items than for 
individuals. The marginal reproducibilities for the three years were 
.70, .68, and .79 respectively. 



(Insert Table 1) 



Fo7r the Court scale the item marginals and errors are given in 

Table 2. Again, as with the Rundquist-Sletto scale, the rank order of 

2 

the items remained very stable. The marginals varied from 37 • 9 percent 
to 85.5 percent positive responses. Most of the items increased in level 
of positive response over the three years. The item errors were somewhat 
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less stable. The scale reproducibilities were all .90 in veilue, bat 
the scalabilities were .68, .73, and .67. Over all three years there 
were more errors over items than for individuals. The mininnim marginal 
reproducibilities were .68, .63, and .69 respectively. The percent of 
pure scale types were 32% for 1967, 33% for 1968, and 555^ for 1969 . 



(Insert Table 2) 



In Table 3 the item marginals and errors are given for the Law 

scale. As with the other scetles the rank order of items remained 

3 

relatively stable over the three years. The item errors were also 
relatively stable. The scale reproducibilities were .93 for 1967, 
.93 for 1968, and .9** for I969. However, the coefficient of scalabilities 
were .72, .76, and .69 for the same years. For all the years there were 
more maximum errors for items than for individuals. The minimum marginal 
reproducibilities were .7^, -72, and .82 respectively. The percent of 
pure scale types were 66% for 1967, 69% for I968, and 75^ for I969. 
Over the years there was a trend upward in the level of positive 
responses to the items on the scale. 

(Insert Table 3) 



The general rank order of items was similar for this study and that 
of Clark and Wenninger (196^*)^^ The reproducibilities for the scales 
for both studies were nearly identical in value* For the Clark and 



Wenninger (I96U) study the item reproducibilities averaged .87. For 
this study no item reproducibility was less than .80 in value. Althou^ 
the scale reproducibilities were high, apparently they are an artifact 
of item errors. For all the scales there were items with m€u:ginals 
greater than Q0% positive responses. This inflated the true scalability 
of the attitude items. In general, the scalabilities of the scales 
were relatively low (no coefficient of scalability was over .76).^ 
The scales should not, therefore, be treated as Guttman scales, but as 
quasi -scales. 
FACTOR ANALYSIS 

Using the original 1 to 5 coding, the items were all used in the 
factor analysis. Not using dichotomous coding, and using all the items 
rather than only those in each theoretical scale, was done in order to 
take into account the criticisms presented earlier about using factor 
analysis of Guttman scales. 

Factor analysis using pr?-ncipal aacis with varimax rotation was used. 
Communalities were estimated using the SMC Td.th iteration. Since the 
standard error of a factor loading was found to be .09j the value of .30 
was chosen as indicating a significant (at the .001 level) loading. 
These loadings were used to indicate the factors associated with the 
legal attitudes. Since at least 10 subjects per item were used, the 
resultfa of the factor analyses should reliably indicate the actual 
patterns present in the data. 

In Table k the results of the factor analysis for the I967 wave are 
given. The items all loaded significantly on the first unrotated factor. 
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Thls means that the itena were clustering together, and this can be 
taken as indicating their conmon scalability (Rumzael, 1970). This factor 
accoimted for the largest percentage of the variance {6l.2%). 

The second bipolar factor, indicates additional variance {2k. 3%) being 
explained by two clusters of items. One cluster (items 1, 2, 9 , 
and 10) seems to be related to the honesty of both the law and legal 
officers, while the second cluster (items 3, 5» 6, 8, and 11) seems 
to be related to one's personal responsibility to obey the law* 



(Insert Table k) 

By 1968, as seen in Table 5» the amount of variance explained by 
the second unrotated bipolar factor dropped to only 1*7% • The items 
on this factor, nonetheless, still loaded in a similar pattern to that 
observed for the responses a year earlier for the same students. The 
first genercLl factor again accounted for over 60% of the common variance • 
Since the second factor did not account for much additional variance, 
rotation was not carried out* 



(Insert Table 5) 



The factor analysis results for the 1969 wave were simileur to 
earlier results. As seen in Table 5» the first general unrotated factor 
accounted for 69% of the common variance, while the second bipolar 
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again only explained an additional 1.1% of the variance. The pattern 
of loadings on this factor were, once again, similar to those found 
for the preceding two waves. As with the preceding year's data rotation 
was not necessary, since the second factor accounted for little additional 
variance beyond that explained by the first. 

SUMMARY Airo CONCLUSION 

For all three legal scales the scale analysis revealed that the 
scales were not Guttman. Although the scale reproducibilities and item 
reproducibilities were high, the scale scalabilities were not significantly 
greater than .60. This low scalability appeared to be the result of 
extremity in the items, and not extremity in individuals. 

The general level of favorable attitudes toward legal institutions 
was lower than in the study by Clark and Wenninger {l96h) . Over the 
three years there appeared to be a trend toward decreased f avorableness 
toward legal institutions. 

Factor analysis of the legal attitude items revealed that the items 
we-e scetlable, and suggested (in the sense of sets of different signs) 
the presence of two possible clusters of items relating to the honesty 
of the lav and legal officials and to the necessity for obedience 
of the law. However, this clustering did not delineate much variance 
left unexplained by the general factor. Thus, with a 1,00 eigenvalue 
selected as a criterion for rotation, delineation of independent clusters 
of items associated with the legal attitudes was not possible for two 
of the three waves. That is, dlsecnr^ry of independently highly correlated 
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sets of items weis not permitted. This failure provides support for 
the criticism of factor analysis of Guttman items presented earlier. 
A clear .pattern of factors among the items was not delineated. This 
result is of mixed blessing. While the sccde items ore not Guttman, 
at leetst they do have a widely interrelated network of association 
which explains a large majority of the common variance. That is, the 
items can fonn a single factor scale. However, because there appeared, 
in general, only one factor of significance, the delineation of independent 
clusters of items was not possible. short, while delineation of the 
stjructure of the scale is given as a justification for use of factor 
analysis with Guttman scales, delineation if successful indicates the 
need to develop better tests of the factors foundy^ jOnly with delineation 
of variance rather than clusters of items (in essence no rotation being 
necessary) will the non-Guttmaji items be adequate to provide a measure 
of the general factor 7^'^ 

Based on the above considerations it appears that use of factor 
analysis with Guttman scales is not a desirable technique of scaling. 
A better approach would be the single use of factor analysis in order 
to help construct single factor scales of greater length. 
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Table 1. Guttman Scsile Item Marginals 8md Item Errors for 
the Rundqtiist-Sletto Scale for the Three Waves of Observation 



I96T 1968 1969 

Item Marpinetl Error Marginal Error Marginal Error 

1 85.5 7.5 79.0 8.2 85.5 8.3 

2 81*. 2 7.1 80.2 5.8 85.1 6.2 

3 77.2 12. It 78.2 12.8 90.1 6.2 
it 65.6 lit. 5 73.7 13.6 83.5 6.2 

5 66.0 16.2 57.6 11.9 70.2 13.2 

6 ltlt.lt 8.3 5l».7 6.2 69.lt 9.5 

7 It3.7 6.6 53.1 9.9 66.1 6.2 
Reproducihility .90 .90 .92 ' 

Scalability .65 .69 .63 
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Table 2. Guttman Scale Item Meirglnals and Item Errors 
for the Court Scale for the Three Waves of Observation 



1967 



Item 


Marginal 


Error 


1 


85.5 


5.0 


2 


81*. 2 


2.5 


3 




8.7 


k 


51.9 




5 


31.0 


19.1 


6 


39.0 


12.9 


Reproducibility 


.90 





Scalability .68 



Marginal 


Error 


Marginal 


Error 


79.0 


5.3 


85.5 


8.3 


80.2 


5.8 


85.1 


6.6 


5l*.7 


13.6 


69.1* 


ll*.9 


51.1* 


11.5 


61*. 0 


lk.3 


1*6.9 


11*. 1* 


52.9 


3.7 


37.9 


7.8 


55.8 


13.2 


.90 




.90 




.73 




.67 
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Table 3. Guttman Scale Item Mai*ginals and Item Errors 
for the Law Scale for the Three Waves of Observation 



1967 1968 1969 



Item Marginal 


Error 


Marginal 


Error 


Mari?inal 


Error 


1 


90.5 


6.6 


90.1 


5.8 


9lt.2 


k.l 


2 


77.2 


7.5 


78.2 


U.l 


90.1 


5.i» 


3 


79.3 


8.7 


82.7 


6.2 


87.6 


3.7 


k 


66.0 


11.2 


57.6 


12.8 


TO. 2 


13.2 


5 


It2.7 


2.1 


53.1 


ij.l 


66.1 


1.7 


Reproducibility 


.93 




.93 




.9i» 




Scalability 


.72 




.76 




.69 





Table h. Principal Axis end Vaximax 
Factor Matrices for the 196? Wave^ 



Unrotated Matrix Rotated Matrix 

Factors Factors 



Items 


1 


2 


1 


2 


1 


-371 


-i»55 


-020 


587 


2 


-63l» 


-3lt8 


2lt9 


679 


3 


-4bO 


19 b 


475 


155 


k 


-372 


-286 


092 


it6o 


5 


-581t 


005 


ItU3 


380 


6 


-520 


267 


567 


liH 


7 


-609 


262 


631 


2C3 


8 


-It8U 


329 


581 


071 


9 


-511 


-253 


218 


527 


10 


-227 


-252 


005 


339 


11 


-312 . 


1»22 


512 


-113 


Eigenvalues 


2.516 


1.001 


1.86 


1.66 


% V 

c 


61.2^ 


2i».3:^ 


52.9^ 




a 

Decimals 


omitted 









Table 5. Principal Axis Factor Matrices ^ 
for the 1968 and I969 Waves of Observation 



1968 1969 

Factors Factors 

Item 1 2 12 

1 -650 351* -535 352 

2 -635 U51 -537 i^Qg 

3 -536 -088 -551 -185 
k -530 260 -503 223 

5 -593 -023 -597 130 

6 -6oIt -253 -52lt -323 

7 -621 -392 -61tl -30lt 

8 -595 -312 -568 -290 

9 -I»77 190 -550 259 

10 -336 llh -h^l Okk 

11 -508 -277 -1*71 -271 

Eigenvalues 3. 1*5 .85 3.2k .81 

% Common 
Variance 

Explained 69.055 1.75? 69.2% 1.1% 



Decimals omitted 



The marginals for the items were somevhat Higher than those found by 
Clark and Wenninger {196k). There the marginals vere (using the same 
order of items): 79*5, 73*0, 69-5, 67.5, 50.5, 1*8.5, and 1*3.5 percent 
positive responses. 

The item marginals for the items found by Clark end Wenninger (1961*) 
were as follows: 72.3%, 69-5^, 66.0^, 51.5?5, and 1*2.5^. 

The order of items was essentially as that found in Clark and Wenninger 
(1961*). There the marginals were: 79.5, 73.0, 1*8.5, 1*2.5, 35.0, and 
29. 5 percent. 

In the Clark and Wenninger (1961*) study the Juveniles in the rural farm 
area (N=27l*) held more favorable attitudes toward legal institutions than 
did youth in the urban areas. Also they found that older youth in the 
rural farm areas were more likely to hold negative attitudes than the 
younger youth. For these data the percent of youth holding favorable 
attitudes toward legal institutions (0-3 on the Rundquist-Sletto scale) 
were (omitting those with undecided responses) 1*2.7^ in 1967, 1*1.3^ in 
1968, and 28.7^ in 1969. This contrasts with a 5&% level of favorable 
response (no undecided responses) found by Clark and Wenninger in 196I. 
Therefore, the data from this study are somewhat lower in the level of 
favorable attitudes toward legal institutions than those rural youth 
investigated in 1961. In addition, over the high school years as the 
youth age, the level of favorable response toward legal institutions 
drops (quite dramatically from 1968 to 1969)* 

Using the cross-section of the total high school population for 1967 • 
and 1968 the l«vel of favorable response was 1*3.6^ and 1*3.3^ respectively. 
The undecided responses were not used. The N*s varied from 3l*0 to 1*00. 



When the "imdecided" responses were not used in the analysis, the 
coefficients of reproducibility for the scales were not affected. 
The scalabilities tended to decrease slightly. When the total 
cross-sectional high school populations for 1967 and I968 were 
used, the reliabilities were similar to those obtained above, and 
the stabilities remained solidly in the .60 range. 



